BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification

Multi-label Text Classification (MLTC) is the task of categorizing documents into one or more topics. Considering the large volumes of data and varying domains of such tasks, fully supervised learning requires manually fully annotated datasets which is costly and time-consuming. In this paper, we propose BERT-Flow-VAE (BFV), a Weakly-Supervised Multi-Label Text Classification (WSMLTC) model that reduces the need for full supervision. This new model (1) produces BERT sentence embeddings and calibrates them using a flow model, (2) generates an initial topic-document matrix by averaging results of a seeded sparse topic model and a textual entailment model which only require surface name of topics and 4-6 seed words per topic, and (3) adopts a VAE framework to reconstruct the embeddings under the guidance of the topic-document matrix. Finally, (4) it uses the means produced by the encoder model in the VAE architecture as predictions for MLTC. Experimental results on 6 multi-label datasets show that BFV can substantially outperform other baseline WSMLTC models in key metrics and achieve approximately 84% performance of a fully-supervised model.Comment: 8 pages, 4 figure

Measuring the impact of COVID-19 on heritage sites in the UK using social media data

The COVID-19 pandemic has had a profound impact on almost all aspects of society. Cultural heritage sites, which are deeply intertwined with the tourism industry, are no exception. The direct impacts of the virus on the population, as well as indirect impacts, such as government-mandated measures including social distancing, face coverings, and frequent temporary closures of sites, have greatly impacted visitor experiences at heritage sites. To quantitatively evaluate the impact of these measures from the perspective of visitors, we collected 1.4 millions visitor reviews from the Google Maps platform for 775 heritage sites. We analyzed visiting rates using the number of online reviews as a proxy and adopt state-of-the-art natural language processing techniques to more deeply understand visitor perception of preventive measures put in place to control the spread of COVID-19. Our findings reveal that even if visitor focus on COVID-19 has significantly decreased, there may still be notable difference between actual and expected number of reviews, suggesting that visitor involvement (e.g., number of visitors) for cultural heritage sites, especially urban indoor sites, needs more time to recover. Our findings further show that most comments by visitors to sites were associated with negative sentiment toward restricted access, but recognized the necessity of other safeguarding measures (e.g., social distancing and the requirement for face coverings). Moreover, they exhibited negative sentiment towards staff or other visitors who did not adhere to these measures. We make specific recommendations for heritage sites to adapt to the COVID-19 pandemic and a more general observation that the method used to gather information from online reviews in this paper will be effective in measuring visitor perceptions towards specific aspects of heritage sites, particularly in capturing changes in perception before and after unexpected or disruptive events at heritage sites

Renal collecting duct carcinoma with extensive coagulative necrosis mimicking anemic infarct: report of a case and the literature review

Collecting duct carcinoma (CDC) with a mass of coagulative necrosis is very rare. We report here a case of CDC with extensive geographic coagulative necrosis mimicking anemic infarct with tumor cells embedded around the necrotic foci in a 73-years-old man. Histopathological examination showed that tumor nests near the necrotic foci were arranged as angulated tubules, tubulopapillary and glandular structures. Neoplastic cells had moderate to abundant eosinophilic cytoplasm and large hyperchromatic nuclei with prominent nucleoli as Fuhrman nuclear grade 3 or 4. The tumor cells were positive for pan-Cytokeratin, Vimentin, E-cadherin, CD10, and CK7, confirming the diagnosis as CDC. The patient is still alive 6 months later from nephrectomy, a long time following up is needed to learn the prognosis. Conclusively, morphology from different portions of the lesion, immunohistochemical stain and the combination analysis of the radiological features is essential to make a precise pathological diagnosis of CDC. And CDC should also be distinguished from clear cell renal cell carcinoma, renal medullary carcinoma, urothelial carcinoma with glandular differentiation, renal neuroendocrine tumor, renal epithelioid angiomyolipoma, renal pigmented paraganglioma and renal mesenchymal chondrosarcoma etc. VIRTUAL SLIDES: The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/126427052597503

The Prognostic Significance of Apoptosis-Related Biological Markers in Chinese Gastric Cancer Patients

BACKGROUND AND OBJECTIVE: The prognosis varied among the patients with the same stage, therefore there was a need for new prognostic and predictive factors. The aim of this study was to evaluate the relationship of apoptosis-related biological markers such as p53, bcl-2, bax, and c-myc, and clinicopathological features and their prognostic value. METHODS: From 1996 to 2007, 4426 patients had undergone curative D2 gastrectomy for gastric cancer at Fudan University Shanghai Cancer Center. Among 501 patients, the expression levels of p53, bcl-2, bax, and c-myc were examined by immunohistochemistry. The prognostic value of biological markers and the correlation between biological markers and other clinicopathological factors were investigated. RESULTS: There were 339 males and 162 females with a mean age of 57. The percentages of positive expression of p53, bcl-2, bax, and c-myc were 65%, 22%, 43%, and 58%, respectively. There was a strong correlation between p53, bax, and c-myc expression (P=0.00). There was significant association between bcl-2, and bax expression (P<0.05). p53 expression correlated with histological grade (P=0.01); bcl-2 expression with pathological stage (P=0.00); bax expression with male (P=0.02), histological grade (P=0.01), Borrmann type (P=0.01), tumor location (P=0.00), lymph node metastasis (P=0.03), and pathological stage (P=0.03); c-myc expression with Borrmann type (P=0.00). bcl-2 expression was related with good survival in univariate analysis (P=0.01). Multivariate analysis showed that bcl-2 expression and pathological stage were defined as independent prognostic factors. There were significant differences of overall 5-year survival rates according to bcl-2 expression or not in stage IIB (P=0.03). CONCLUSION: The expression of bcl-2 was an independent prognostic factor for patients with gastric cancer; it might be a candidate for the gastric cancer staging system

Two \u3ci\u3eMagnaporthe\u3c/i\u3e appressoria-specific (MAS) proteins, MoMas3 and MoMas5, are required for suppressing host innate immunity and promoting biotrophic growth in rice cells

In the devastating rice blast fungus Magnaporthe oryzae, six Magnaporthe appressoria-specific (MAS) proteins are encoded by MoGAS1, MoGAS2 and MoMAS3–MoMAS6. MoGAS1 and MoGAS2 were previously characterized as M. oryzae virulence factors; however, the roles of the other four genes are unknown. Here, we found that, although the loss of any MAS gene did not affect appressorial formation or vegetative growth, ΔMomas3 and ΔMomas5 mutant strains (but not the others) were reduced in virulence on susceptible CO-39 rice seedlings. Focusing on ΔMomas3 and ΔMomas5 mutant strains, we found that they could penetrate host leaf surfaces and fill the first infected rice cell but did not spread readily to neighbouring cells, suggesting they were impaired for biotrophic growth. Live-cell imaging of fluorescently labelled MoMas3 and MoMas5 proteins showed that during biotrophy, MoMas3 localized to the apoplastic compartment formed between fungal invasive hyphae and the plant-derived extra-invasive hyphal membrane while MoMas5 localized to the appressoria and the penetration peg. The loss of either MoMAS3 or MoMAS5 resulted in the accumulation of reactive oxygen species (ROS) in infected rice cells, resulting in the triggering of plant defences that inhibited mutant growth in planta. ΔMomas3 a nd ΔMomas5 biotrophic growth could be remediated by inhibiting host NADPH oxidases and suppressing ROS accumulation. Thus, MoMas3 and MoMas5 are novel virulence factors involved in suppressing host plant innate immunity to promote biotrophic growth